Virtual mirror based on 3D shape reconstruction and real-time face tracking

A simple 3D virtual mirror interface system is proposed for acquisition and reconstruction of facial pattern, which enables a real time tracking of 3D facial pattern. The movement of lip in the face, which can be estimated based on mean shift and Kalman filter is introduced to recognize the rotation and parallel shift of face. Modified Photometric Stereo Method (PSM) is also proposed to acquire the 3D shape without the influence of deficiency in shadow area of the object. It is shown that the proposed system is effective to acquire and reconstruct for the real-time tracking of 3D facial pattern image than traditional approaches.